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(54) Weighted median filter Interpolator 

(57) A weighted median filter interpolator for the 
interlaced to progressive conversion of video signals is 
proposed in which for example depending on the availa- 
ble or processabie source fields the filter interpolator 
mode can be set to realize either a three-tap weighted 
median interpolator or a five-tap weighted median inter- 
polator by respective selection of the weights such that 
the number of median samples to be processed at a 



vertica} Unas 



certain time is always an odd number. An increased out- 
put quality is achieved if in the case of the five-tap 
weighted median IPC filter mode a three-dimensional 
filter aperture is set spreading over a horizontal, a verti- 
cal and a temporal dimension of three consecutive 
fields of an incoming interlaced video signal. 
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T a top pixel 
B = bottom pixel 
P a predecessor pixel 
Ss successor pixel 
I 3 center of gravity 
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Description 

[0001 ] The invention relates to a weighted median filter interpolator, in particular for an interlaced to progressive con- 
version process of video signals. 
5 [0002] Weighted median filters are known in the art (see e.g. Lit. [1]). They represent a more general approach to rank 
dependent median operators. The generalization relates to (a) sample dependent weight(s), which can be seen as a 
repetition operator of the respective samples. Following this understanding, a weight of "0" means, the respective sam- 
ple is not considered in the ranking operation. 

[0003] Interlaced to progressive conversion refers to the problem of interpolating the missing lines in an interlaced 
10 scanned video signal by use of a signal interpolation algorithm (IPC algorithm) to represent a resulting signal in a pro- 
gressive scan raster. More or less motion insensitive methods for the scan raster conversion have been proposed and 
are known (see e:g. Lit. [2] and [3]) . 

[0004] For the IPC interpolation process, it is known to use so-called five-tap median f flters. As disclosed in Lit. [2], 
the inputs to the filter are for example the corresponding pixels from the previous and the next frames, their linear aver- 
15 age and the pixels from the line above and below. Similarly, three-tap median filters were also proposed for the 100 Hz 
interlaced to interlaced conversion (see Lit. [4]). 

[0005] Problems with the known or formally proposed filters are their poor behaviour in either the temporal domain, 
i.e. poor motion portrayal and remaining flicker artifacts in progressive display modes, or in the spatial domain the loss 
of resolution and fuzzy vertical edges. 
20 [0006] Based on the knovwi proposal of weighted median filter approaches, it is an object of the present invention to 
improve interpolation filters proposed for the interlaced to progressive conversion of video signals in the direction of 
more flexibility depending on available source fields at a certain time. 

[0007] A weighted median filter interpolator for the interlaced to progressive conversion of video signals is character- 
ized according to the invention by means for adjusting specific filter modes by setting the weights such that the number 
25 of median samples to be processed at a certain time is always an odd number. Preferably, the weight of a single sample 
is either "0" or "1 ". As a most preferred embodiment, according to tiie invention a five-tap median filter is used of which 
the actual filter aperture depends on the selected filter mode defined by the respective number of sample weights 
according to the available source fields at a certain time. 

[0008] According to the invention a specific set of weights is selected to deifine a specific IPC interpolation filter. Thus 
30 a general IPC interpolation filter provides according to a selected mode a specific output quality depending on the avail- 
able source fields. 

[0009] In particular, for a five-tap median interpolator, two sub-sets define two alternative interpolation filters included 
in a five-tap weighted median filter sti-ucture. For example, in tiie case of a five-tap weighted median IPC filter, a three- 
dimensional filter aperture is realizable spreading over a horizontal, a vertical and a temporal dimension of three con- 

35 secutive fields of an incoming interlaced video signal, in particular if a spatial linear filter output sample is used. The 
actual filter aperture depends on the filter mode, and tiius on the respective sample weights. 
[001 0] The filter behaviour varies with the modes depending on the weights of the source signal samples, which pref- 
erably are a top pixel T, a bottom pixel B, a previous (field) pixel P, a successive (field) pixel S and a linear source signal 
sample, which preferably is a horizontal/vertical linear filter sample. 

40 [001 1 ] The weight of a single sample can be either "0" or "1 The weight settings specified by the present invention 
are such that the number of median samples is always an odd number, i.e. preferably and in the case of a five-tap 
median filter "1", "3 " or "5". By this selection according to the invention, tiie median operator becomes unambiguous. 
For example* if the number of weights = "1 " is three, then the median is derived from these three samples, whereas if 
the number of weights = "1" is five, the median is derived from said five samples. 

45 [0012] Specific and advantageous embodiments of tiie invention and further details thereof are described in the fol- 
lowing with reference to the accompanying drawings, which however are not to be understood as a limitation of the 
invention, the scope of which is defined by the main ciaim(s) and as the case may be by dependent claims in additional 
consideration of the general knowledge of the expert in tiiis field of IPC Interpolation technology. 

50 Fig. 1 visualizes three vertical-temporal scan raster modules by use of a five-tap weighted median filter of which 
the fitter apertures are defined by tiiree different settings; 

Fig. 2 shows an IPC module with a five-tap weighted median operator in which the weights for all five-taps are set 

to "1"; 

55 

Fig. 3 depicts an IPC module with realization of a three-tap median operator and selection of the weights to be "1 " 
for a top pixel T, a bottom pixel B and a previous pixel P (see central part of Ftg. 1); 
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Rg. 4 shows an IPC module with realization of a three-tap median operator by selection of three weights to be "1 
i.e. for consideration of a top pixel X a bottom pixel B and a successor pixel S (see also right-hand picture 
part of Fig. 1); 



5 Rg. 5 visualizes a line delay scheme for an IPC filter synchronization with three and five weights of a multi-tap 
median operator being selected to be "r. respectively; 

Rg. 6 depicts the basic version of a functional operator scheme to generate the median output of five input values 
by sorting-out the maximum three times; and 

10 

Rg. 7 shows a modified version of a five-tap median operator realizing an algorithm for finding out the median of 
five input values, one of wl^ch uses the output of linear filter part. 



[0013] in Rg. 1 to Rg. 4 the "center of gravity of the interpolator" or in other words the "center of filter operation" is 

75 underlayed and framed by a shaded area in each case. 

[0014] The left hand part of Rg. 1 shows the center of gravity to be applied to a five-tap median operator for which - 
in accordance with the invention - all weights are set to "1 Accordingly, the number of median samples is five. The filter 
accesses samples of three successive fields and the center of gravity is at the previous input field, thus causing a one- 
field output delay (see Rg. 2). For this "set 1 " the median samples are taken from a top pixel T, a bottom pixel B, a pre- 

20 vious (field) pixel P, a successive (field) pixel S and from a spatial linear filter output, in the present case a vertical filter 
sample FIR filtered according to the linear function FIR X = (T + B)/2 . 

[0015] As shown in Fig. 7, if compared against the basic version of a five input values median operator of Fig. 6, using 
the spatial linear filter output sample, two comparators may be saved thus simplifying the structure of the five-tap 
median operator, whereas in the case of Rg. 6 the median value is generated according to the function: 

25 

MEDIAN (a, b. c. d. e) =: MAX{MIN[MIN(a,W): MAX(X,Y)1; MAX[MIN(X;Y);2]}, wherein 



W = MAX{b; r^AX(c;f^AX(d;e)l) 

X = MIN{b; MAX[c;MAX(d;e)]} 

30 Y = MAX{MIN[c;MAX(d.e)]; MlN(d;e)} 

Z = lVllN{MIN[c;MAX(d.e)]; MIN(d;e)). 



[0016] With the simplifying assumption a^c^eore:^c^d from Rg. 6. which leads to the following assumption in 
Fig. 7: T ^ linear ^ B or B ^ linear ^ X the five-tap median operator of Fig. 7 is defined by the more simplified function: 

55 

MEDIAN = MAX{M1N(W,X),MAX(YZ)}, wherein 



W = M)N{S, MAXIP.MAX(T,B)]} 
X = MAX{MIN[P,MAX(T.B]; linear} 
40 Y= MIN{MIN[P.MAX(TB)1. linear} 
Z = MIN{T.B}. 

[0017] Referring again to Rg. 1, the middle part of this figure visualizes as "set 2" a three-tap median mode using a 
previous field sample by setting three of five possible weights to "1" and two weights to "0". i.e. T = 1,B = 1,P = 1,S = 
45 0, linear = 0. As shown in Fig. 3. thus an IPC module with a three-tap median operator is realized, which may be called 
a "three-tap median predecessor operator". 

[0018] Having again a look to the right hand part. Fig, 1 shows a third possible mode of operation by which the filter 
accesses samples of two successive fields and the center of gravity is at the current input field, thus causing no output 
delay. For this mode called "set 3", again three of the five possible weights are selected to be "1", i.e. T = 1, B = 1, S = 
50 1 , whereas two weights are set to be "0", i.e., P = 0 and linear = 0. As shown in Fig. 4, by this setting an IPC module is 
realized that may be called "three-tap median successor operator". 

[001 9] The diagram of Fig. 5 visualizes the respective line and field delay(s) of each of the above explained IPC inter- 
polation modes, i.e., 



55 - for the three-tap median processor mode with 



-- case A: odd fields coming in. 
- case B: even fields coming in; 
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- for the three tap median successor mode 

- case C: odd fields coming in, 

- case D: even fields coming in; and 

for the five-tap median mode with 

case E: vertical odd fields coming in, 
~ case F: even fields coming in. 

[0020] The fields with gray underlaying refer to the source lines needed for a respective IPC filter processing, whereas 
a vertical crossbeam indicates the respective fields tabe interpolated. The shaded areas also indicate the filter aper- 
tures for each case and the respective delay for the incoming source lines is also shown. 

[0021] Using a weighted median filter interpolator according to the invention, the main advantages achieved are an 
improved IPC interpolation performance compared to median interpolators of the prior art and a higher flexibility for the 
adaptation to various source field situations. A particular advantage over prior art implementations is-achieved with a 
three-dimensional filter aperture in the case where a linear sample used as one weight value for the median filter inter- 
polator is generated as a spatial dimension sample. This is to be seen in contrast to the case in Lit. [2] where a linear 
sample generated as a purely temporal dimension sample is used as the fifth median sample. In this case, the temporal 
linear sample Is derived as the average of the samples P and S. 

Prior Art Literature: 

[0022] 

Lit. [1] B. Arnold, N. Balakrishnan, H. Nagaraja: 

A first course in order statistics; John Wiley & Sons, New York, 1992; 

Lit. [2] K. Oeistaemoe and Y. Neuvo; 

A Motion Insensitive Method for Scan Rate Conversion and Cross Error Cancellation; IEEE Transactions on Consumer 
Electronics, Volume 37. No. 3, August 1991, pp. 296 to 300; 

Ut.[31 

US 5 483 288 

Lit. [4] G. de Haan, P. Biezen, 0. Ojo: 

An Evolutionary Architecture for Motion-Compensated 100 Hz Television, IEEE Transactions on Circuits and Systems 
for Video Technology, Volume 5, No. 3, June 1995, pp. 207 to 217. 

Claims 

1 . A weighted median filter interpolator, characterized by means for selecting specific filter modes on a pixel by pixel 
basis by setting the weights such that the nun^er o1 median sampies to be processed at a certain time is always 
an odd number. 

2. The weighted median filter interpolator according to claim 1 , wherein the weight of a single sample is either "0" or 
"r. 

3. The weighted median tiller interpolator of claim 2 used for interlaced to progressive signal conversion, character- 
ized by a five-tap median filter of which the actual filter aperture depends on the selected filter mode defined by the 
respective number of sample weights. 

4. The weighted median filter interpolator according to claim 3, wherein means are provided for selecting the respec- 
tive filter mode according to available or processable source fields. 

5. The weighted median filter interpolator of daim 4, wherein ihe respective filter mode depends on the selected 
weights of interlaced video signal samples. 
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6. The weighted median filter interpolator of claim 5, wherein the weights are selected for a multi-dimensional filter 
aperture over a horizontal and/or a vertical and/or a temporal dimension of three consecutive fields of an incoming 
interfaced video signal . 

5 7, The weighted median filter interpolator according to claim 6, wherein said video signal samples for generating a 
median value are selected with weights T or "0" from a top pixel T, a bottom pixel B, a previous field pixel P, a suc- 
cessive field pixel S and from a spatial linear filter output sample FIR X. 

8. The weighted median filter interpolator according to claim 7, wherein all five available median samples are selected 
10 with the weight "r. 

9. The weighted median filter interpolator according to claim 7, wherein the number of median samples with weight 
T is three, and the other two median samples are set to *'0\ 

IS 10. The weighted median filter interpolator according to claim 9, wherein a three-tap median mode is selected with the 
following settings T = 1 , B « 1 , P = 1 , S=0 and FIR X a 0. 

1 1 . The weighted median fitter interpolator according to claim 9, wherein a three-tap median mode is selected with the 
following settings: T « 1, B = 1 , P = 0. S = 0 and FIR X = 0. 

12. The weighted median filter interpolator according to claim 8, wherein the median of said five video signal samples 
is generated according to the function: 

MEDIAN = Max {Min (W.X); Max (Y, 2)}. wherein 

25 

W = Mtn {S; Max [P; Max (T B)]}; 

X = Max{Min[P;Max(T.Bl; FIR X}; 

Y = Min {Min [P.Max (T, B)], FIR X): 

Z= Min{T.B}, 

30 
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